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ABSTRACT 



This report explores why some schools may be better than 
others at helping students learn. It responds to the congressionally mandated 
Special Study Panel on Education Indicators, which asked the National Center 
for Education Statistics to examine indicators of the health of the nation's 
educational system. The report reviews the literature on school quality and 
is intended to help policy makers and researchers understand those 
characteristics that are most likely related to student learning. It 
identifies the availability and reliability of national indicators and 
assesses the current status of schools by examining and critiquing these 
national indicator data. The report claims that school quality, as it affects 
student learning, is demonstrated by the training and talent of the teaching 
force, what goes on in the classrooms, and the overall culture and atmosphere 
of the school. Within these three areas, the document identifies 13 
indicators of school quality that recent research suggests are related to 
student learning. Findings indicate that students learn more from teachers 
with high academic skills and who teach subjects related to their 
undergraduate or graduate studies than they do from teachers with low 
academic skills and who teach subjects unrelated to their training. (Contains 
146 references.) (RJM) 
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This report explores why some schools may be better than others at helping students 
learn. It responds to a recommendation from the congressionally mandated Special Study 
Panel on Education Indicators for the National Center for Education Statistics (NCES) for 
reports that identify and discuss indicators of the health of the nations educational sys- 
tem (U.S. Department of Education 1991). This report is designed for policymakers, 
researchers, and others interested in assessing the strength of our schools. While it is rele- 
vant for those interested in standards or accountability, it is not about test scores and is 
not a guide for education reform movements. 

More specifically, the report’s primary goals are to 

1. Review the literature on school quality to help policymakers and researchers 
understand what is known about the characteristics of schools that are most like- 
ly related to student learning, 

2. Identify where national indicator data are currently available and reliable, and 

3. Assess the current status of our schools by examining and critiquing these 
national indicator data. 



SCTO©L CMARACTERDSTDCS 
RELATED T© STODEMT LEARNON 



The research described in this report indicates that school quality affects student learn- 
ing through the training and talent of the teaching force, what goes on in the class- 
rooms, and the overall culture and atmosphere of the school. Within these three areas, 
this report identifies 13 indicators of school quality that recent research suggests are 
related to student learning and reviews the national data showing the current status of 
our schools. These indicators, and the quality of the data describing each, are summa- 
rized in Figure ES.l. The figure illustrates that these school quality factors can affect 
student learning both directly and indirectly For example, school context characteristics 
like school leadership can have an impact on teachers and what they are able to accom- 
plish in the classroom, and this in turn may influence student learning. In addition, var- 
ious teacher-level attributes can affect the quality of the classroom and in turn student 
learning. Traits at each of these levels can also directly affect student learning. 

Teachers 

Substantial research suggests that school quality is enhanced when teachers have high 
academic skills, teach in the field in which they are trained, have more than a few years 
of experience, and participate in high-quality induction and professional development 
programs. Students learn more from teachers with strong academic skills and classroom 
teaching experience than they do from teachers with weak academic skills and less expe- 
rience. Teachers are less effective in terms of student outcomes when they teach cours- 
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es they were not trained to teach. Teachers are thought to be more effective when they 
have participated in quality professional development activities, but there is no statisti- 
cal evidence to evaluate this relationship. 



To understand the effectiveness of classrooms, research suggests that it is necessary to 
understand the content of the curriculum; the pedagogy, materials, and equipment 
used. Students appear to benefit when course content is focused and has a high level of 
intellectual rigor and cognitive challenge. Younger students, especially disadvantaged 
and minority students, appear to learn better in smaller classes. Nationally representa- 
tive data on the process of schooling, now becoming available for the first time, will fur- 
ther our understanding of the role of these factors in determining school quality. 

School Context 

How schools approach educational leadership and school goals, develop a professional 
community, and establish a climate that minimizes discipline problems and encourages 
academic excellence clearly affects school quality and student learning. For three reasons, 
however, the effect of school-level characteristics is more difficult to ascertain than the 
effect of teachers and classrooms. First, even though they are integral to a school, these 
characteristics are difficult to define and measure. Second, their effect on student learn- 
ing is likely to be exerted indirectly through teachers arid classrooms, compounding the 
measurement problem. And last, with some exceptions, reliable school-representative 
information about these indicators of quality is minimal. These difficulties should 
not overshadow the importance of collecting such data to learn more about how these 
characteristics operate and affect student learning through teachers and classrooms. 
The preponderance of national, regional, and local efforts to develop quality schools 
heightens the benefits that would be derived from additional refined and reliable school- 
representative measures of school characteristics. 
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The quality of existing data on these three types of indicators varies (Table ES.l). Where 
the dimension being measured is straightforward, or if it has been measured for an 
extended period of time, the data are high quality. Where there is little information 
about a particular important facet of an indicator, the data quality is moderated in some 
aspect. And where the indicator is more complex than the data, the quality is poor. For 
a few indicators, concrete statistical evidence of an association with learning is thin, 
even though experts agree that these indicators should enhance student learning. 

The indicators of teacher assignment, teacher experience, and class size each represent 
straightforward concepts and are easy to measure, and the data on these indicators are 
high quality. In addition, data on teacher experience and class size have been collected 
over several decades, further ensuring their quality. Data on teacher academic skills are 
' also high quality, albeit less straightforward. While the academic skills of teachers are 
only one aspect of teaching ability, standardized tests that measure the academic skills of 
future teachers are quite advanced and have consistently shown links to student learning. 

Data on indicators of professional development, course content, technology, discipline, 
and academic organization are moderate in quality. National data-collection efforts 
pertaining to these indicators are relatively new, and these dimensions of schools are 
more complex than the data currently collected. Consequently, data on professional 
development are limited and provide little insight into important principles of success- 
ful professional development programs. National data on indicators of course content 
and academic environment are based primarily on course titles and are consequently 
too vague to be high quality. Current data on technology primarily measure the avail- 
ability of hardware and access to the Internet and provide too little information on the 
instructional role of technology in the classroom. Nationally representative data on 
school discipline incidents and on school discipline policies are well defined, but 
administrators may underreport their discipline problems. In addition, there are limit- 
ed data documenting a link to student learning, the implementation of discipline poli- 
cies, and their perceived fairness. 

Only poor-quality data are available on teachers’ pedagogy, school leadership, school 
goals, and professional community. These indicators are complex and therefore more 
difficult to measure, and historically they have not been prominent in national data- 
collection efforts. It is difficult to isolate and measure critical elements of pedagogy 
because the teaching process consists of a complex set of interactions between students, 
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Executive Summary iii 



the teacher, and the curriculum. Measuring human actions, incentives, and opinions to 
estimate the effects of school-level attributes such as leadership, goals, and professional 
community is an equally complex task. 

As a group, the teacher-focused measures of school quality are less complex and have 
been collected for some time. School-level attributes of quality are nearly the opposite. 
We have more reliable information on indicators with high-quality data, while indica- 
tors with lower-quality data provide an incentive and direction for improved national 
data collection. Nine indicators have high- or moderate-quality data and describe the 
current status of school quality. 

OMRENT STATIUS ©E §CM©L QWAUW 



The Academic Skills of Teachers 

Students learn more from teachers with strong academic skills (Ballou 1996; Ehrenberg 
and Brewer 1994; 1995; Ferguson 1991; Ferguson and Ladd 1996; Mosteller and 
Moynihan 1972), but graduates whose college entrance examination scores are in the top 
quartile are half as likely as those in the bottom quartile to prepare to teach (9 versus 18 
percent) (Henke, Chen, and Geis 2000). Teachers in the top quartile are more than twice 
as likely than teachers in the bottom quartile to teach in private schools (26 versus 10 per- 
cent) and are less than one-third as likely as teachers in the bottom quartile to teach in 
high-poverty schools (10 versus 31 percent). Furthermore, graduates in the top quartile 
who teach are twice as likely as those in the bottom quartile to leave the profession with- 
in less than four years (32 versus 16 percent) (Henke, Chen, and Geis 2000). 



Middle and high school students learn more from teachers who hold a bachelor’s or 
master’s degree in the subject they are teaching (Darling-Hammond 2000; Goldhaber 
and Brewer 1997; Monk and King 1994), but out-of-field teaching occurs with regular- 
ity (Bobbitt and McMillen 1994; Henke et al. 1997; Ingersoll 1999; Lewis et al. 1999). 



Teacher Experience 

Studies suggest that students learn more from experienced teachers than they do from 
less experienced teachers (Darling-Hammond 2000; Murnane and Phillips 1981; 
Rivkin, Hanushek, and Kain 1998). As of 1998, the highest-poverty schools and schools 
with the highest concentrations of minority students had nearly double the proportion 
of inexperienced teachers (those with three or fewer years of experience) than schools 
with the lowest poverty (20 versus 1 1 percent) and lowest concentration of minority 
students (21 versus 10 percent). 



Professional Development 

Experts agree that high-quality professional development should enhance student 
learning (Choy and Ross 1998; Mullens et al. 1996; U.S. Department of Education 
1999a), but data permitting an analysis of the relationship are not yet available. In 1998, 
99 percent of the nation’s public school teachers had participated in some type of pro- 
fessional development program within the past 12 months (U.S. Department of 
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Education 1999). However, most teachers participated in these activities from only one 
to eight hours, or for no more than one day. Teachers with three or fewer years of expe- 
rience were more likely (Lewis et al. 1999) to have reported participating in an induc- 
tion program in 1998-99 than in 1993-94 (65 versus 59 percent). 

Course Content 

Research shows that as students take higher-level academic courses they learn more 
(Raizen and Jones 1985; Sebring 1987). From 1982 to 1998, there was an increase in the 
percentage of students enrolling in higher-level mathematics and science courses (Wirt 
et al. 2000). High school graduates in 1998 were more likely than their 1982 counter- 
parts to take more advanced mathematics courses, such as algebra II, trigonometry, pre- 
calculus, and calculus. In science, the trend is similar. High school graduates in 1998 
were more likely to take chemistry II or physics II and physics I and chemistry I (Wirt 
et al. 2000). Despite these encouraging signs, the experience is not reflected equally 
among racial/ ethnic and income groups. In 1998, white and Asian/Pacific Islander high 
school graduates were usually more likely than black, Hispanic, and American 
Indian/Alaskan Native students to complete advanced academic-level mathematics and 
the highest-level science courses (Wirt et al. 2000). Students from low-income families 
were less likely to be enrolled in a college preparatory track through which they would 
be more likely to take such courses (U.S. Department of Education 1995). 



Research suggests that student learning is enhanced by computers when the computer 
is used to teach discrete skills (Presidents Committee of Advisors on Science and 
Technology Panel on Educational Technology 1997). Computer availability and usage is 
increasing in the schools (Anderson and Ronnkvist 1999). In 1999, there was an average 
of 6 students for each computer, up from a 125 to 1 ratio in 1983 (Coley, Cradler, and 
Engel 1997; U.S. Department of Education 2000b). Internet access existed at 95 percent 
of public schools in 1999, up from 35 percent in 1994 (U.S. Department of Education 
2000b). Internet access will most likely be used most if the computers are in instruc- 
tional rooms. Over half (63 percent) of all instructional rooms (classrooms, computer 
or other labs, and library media centers) had access to the Internet in 1999, up from 
3 percent five years before (U.S. Department of Education 2000b). For schools with high 
concentrations of poverty (more than 70 percent eligible for free or reduced-price 
lunch), 39 percent of all instructional rooms had Internet access compared with 62 to 
74 percent for schools with lower concentrations of poverty (U.S. Department of 
Education 2000b). 

Class Size 

Researchers have found that greater gains in student achievement occur in classes with 
13 to 20 students compared with larger classes, especially for disadvantaged and minor- 
ity students (Krueger 1998; Mosteller, Light, and Sachs 1996; Robinson and Wittebols 
1986). In 1998, the average public elementary school class had 23 students (Lewis et al. 
1999). Large-scale efforts to reduce class size may result in negative consequences if, as 
was the case recently in California, large numbers of unqualified teachers are hired 
because there are not enough qualified teachers available to staff the smaller classes 
(Bohrnstedt and Stecher 1999). 
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Discipline 

Researchers have found that a positive disciplinary climate is directly linked to student 
learning (Barton, Coley, and Wenglinsky 1998; Bryk, Lee, and Holland 1993; Chubb and 
Moe 1990). Research also suggests that the most effective policies to reduce the inci- 
dence of offenses in a school vary according to the targeted behavior. To reduce serious 
incidents, including drug offenses only a policy of severe punishment seems to be effec- 
tive (Barton, Coley, and Wenglinsky 1998). Serious violent crime incidents, occurred in 
10 percent of all public schools in 1996-97 (Kaufman et al. 1999). The level of school- 
related criminal behavior has changed little between 1976 and 1997, and no differences 
in victimization rates were found between white and black high school seniors in 1997 
(Wirt et al. 1999). However, the percentage of middle and high school students who fear 
attack or other bodily harm while at school has been on the rise. In each year, a larger 
proportion of black and Hispanic students than white students feared attacks at school, 
and the percentage of black students who feared for their safety nearly doubled from 
1989 through 1995 (Kaufman et al. 1999). 



Academic OirgamizatioBi 

Students learn more in schools that emphasize high academic expectations (Bryk, Lee, 
and Holland 1993; Chubb and Moe 1990), and academic expectations have been on the 
rise (Wirt et al. 1998). The percentage of public school districts with graduation 
requirements that meet or exceed the National Commission on Excellence in Education 
(NCEE) recommendations (four years of English, three years of mathematics, three 
years of science, three years of social studies, and a half year of computer science) 
increased from 12 to 20 percent between 1987-88 and 1993-94 (Wirt et al. 1998). A 
common criticism of the NCEE recommendations is that they only specify the number 
of courses to be taken, not their rigor. But there is evidence that increasing numbers of 
students have been enrolling in more difficult courses. From 1982 to 1998, there was an 
increase in the percentage of students enrolling in higher-level mathematics and science 
courses (Wirt et al. 2000). 
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School quality needs to be defined, assessed, and monitored if we are to ensure the exis- 
tence of quality schools (U.S. Department of Education 1991). This report highlights 
13 indicators of school quality that recent research suggests may be related to student 
learning and identifies where and why more precise measures are needed. These indica- 
tors fall into three categories: the characteristics of teachers, the characteristics of class- 
rooms, and the characteristics of schools as organizations. Research suggests that stu- 
dents learn more from teachers with high academic skills and teachers who teach sub- 
jects related to their undergraduate or graduate studies than they do from teachers with 
low academic skills and teachers who teach subjects unrelated to their training. In addi- 
tion, students, on average, learn more from teachers with three or more years of teach- 
ing experience than they do from teachers with less experience. Though the research is 
less conclusive regarding professional development, experts agree that participation in 
high-quality professional development should lead to better teaching. At the level of the 
classroom, research suggests that students benefit from a focused and rigorous curricu- 
lum, time spent using computers, and being in smaller classes. We still need to learn 
more about the relationship between pedagogy and student learning. At the school 
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level, a schools goals, leadership, faculty, discipline policy, and academic environment 
are all indicators of school quality. Student learning, however, is thought to occur pri- 
marily as a result of students’ interaction with teachers, other students, and the cur- 
riculum, and the link between learning and these factors is not firmly established for all 
of these indicators. 

Better measures are needed to accurately monitor the status of school quality, especial- 
ly for indicators of pedagogy, leadership, goals, and professional community. 
Furthermore, certain important facets of professional development, course content, 
technology, academic environment, and discipline are missing. Finally, even when qual- 
ity data are available, they lose their value if they are not appropriately defined and kept 
up to date. Moreover, even though experts would agree that certain indicators should 
enhance student learning, there is not always concrete statistical evidence to support 
their supposition; improving the data collected on the dimensions of schools thought 
to be associated with school quality should help us better understand the relationship 
of these indicators to student learning. 

The findings documented in this report, like all research, are time sensitive and part of 
an iterative process. The status of schools as identified by indicators with quality data is 
changing rapidly and will need to be continually updated. As research on school effec- 
tiveness proceeds, indicators with only poor-quality data will need to be improved to 
understand the complete picture of school quality as recommended by the Special 
Study Panel on Education Indicators for the National Center for Education Statistics. 
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The nation’s economic and social health depends on the quality of its schools. If stu- 
dents are not taught the values and social skills necessary to become good citizens and 
do not learn the academic skills necessary to be economically productive, then the 
schools have not succeeded in their mission. To ensure the existence of quality schools, 
school quality needs to be defined, assessed, and monitored (U.S. Department of 
Education 1991). This is one reason the congressionally mandated Special Study Panel 
on Education Indicators for the National Center for Education Statistics (NCES) called 
for indicator data to be regularly presented to the public “by interpretive reports that 
place data and analyses within the context of accessible written essays” (U.S. 
Department of Education 1991, p. 9). The panel called for these reports to focus on six 
issue areas: (1) school quality, (2) learner outcomes, (3) readiness for school, (4) socie- 
tal support for learning, (5) education and economic productivity, and (6) equity (U.S. 
Department of Education 1991, p. 9). This report aims to help fulfill the panel’s request 
in the first issue area, school quality. 1 

The report’s three primary goals are: 

1. Review the literature on school quality to help policymakers and researchers 
understand what is known about the characteristics of schools that are most like- 
ly related to student learning, 

2. Identify where national indicator data are currently available and reliable, and 

3. Assess the current status of our schools by examining and critiquing these 
national indicator data. 

Student learning is, in part, a function of various characteristics of the schools and the 
process of schooling. Examining the characteristics of schools that are related to learn- 
ing illuminates some of the reasons why students are, or are not, learning at optimum 
levels. In its 1991 report “Education Counts: An Indicator System to Monitor the 
Nation’s Educational Health” (U.S. Department of Education 1991), the NCES panel 
called for reports that discuss indicators of the health of the nation’s education system. 
Although it is less common to use indicators to measure the quality of schools than to 
gauge the health of the economy, there are compelling reasons to do so. For example, 
inflation, unemployment, growth rates, imports and exports, and wage growth are indi- 
cators that are looked at both separately and together to gauge the economy’s strength. 
Unemployment might be low while inflation may be high. Each indicator reveals some 
important information about the economy and none alone tells the whole story. 
Similarly, school quality is simultaneously related to several characteristics of schools. It 
is a function of the training and talent of the teaching force, what goes on in the class- 
rooms (including the size of the classes, the topics covered in them, and the pedagogi- 
cal approaches used in them), and the overall culture and atmosphere within a school. 

l This is the second interpretive report produced by NCES. The first report focused on education and 
the economy (Decker, Rice, and Moore 1997). 
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Defining school quality is the first step toward measuring and monitoring it. Both social 
and academic dimensions might be considered. The social includes the attitudes, ambi- 
tions, and mental well-being of students, while the academic dimension pertains to stu- 
dent learning. Both are important, but this report responds to the current national con- 
cern about academic quality by focusing solely on the school characteristics that have 
been shown to improve student learning. 

Even though this report is concerned with what factors of schools are related to learning, 
this is not a report about test scores and the standards and accountability movement. This 
report is, however, still relevant to those interested in standards and accountability. It rec- 
ognizes that some schools facing the same set of standards and accountability measures as 
other schools will do better in meeting them. This report tries to identify why this is the 
case. As the Action Statement from the 1999 National Education Summit noted, “Raising 
standards and developing tests may have been the easiest part of the journey; the more 
daunting task is ensuring that all students reach these standards” (1999 National Education 
Summit 1999). Because some schools do perform better than others, this report looks at 
the components that have been found to be linked to student learning and that may influ- 
ence whether schools are successful in helping their students meet state and local standards. 

Although most of the indicator data presented and critiqued in the report are national 
in scope, the report is intended to be useful to state and local policymakers and 
researchers. The data review will provide those interested in state and local data with an 
idea of what comparable data are needed to monitor state and local systems. 

A. TjjE SCKTOtL QQMUTY LgggMWg 

When thinking about what researchers have learned about school quality, it is useful to go 
back to the debate started by the “Equality of Educational Opportunity” report (Coleman 
et al. 1966), better known as the Coleman Report. This large national study sent shock 
waves through the education community when it concluded that measurable characteris- 
tics of teachers and schools are not significantly related to student achievement. 
Protracted debate has surrounded these findings, and numerous subsequent studies both 
support and refute the Coleman finding. The most comprehensive support, and the most 
widely cited, is Hanushek’s (1986) review of the findings from 38 quantitative studies of 
the determinants of student achievement. These studies assessed the impact of the 
teacher/pupil ratio, teacher education, teacher experience, teacher salary, expenditures per 
pupil, administrative inputs, and facilities. Hanushek concludes that among these studies, 
“There appears to be no strong or systematic relationship between school expenditures 
and student performance” (Hanushek 1986, p. 1,162). 

Many researchers do not accept Hanushek’s conclusions. For example, Hedges, Laine, 
and Greenwald (Hedges, Laine, and Greenwald 1994) claim that his findings rest on 
inappropriate statistical methods and poor data. They conducted two separate studies 
to support their claim. In the first study, they reanalyzed studies Hanushek used and 
found a “positive relationship between dollars spent on education and output” that “is 
large enough to be of practical importance” (Hedges, Laine, and Greenwald 1994, p. 5). 2 



2 The authors report that some of the studies used by Hanushek were excluded because they did not 
provide enough information to use in their analysis. The excluded studies were those that reported non- 
significant resource effects and did not report the sign of the coefficient. 
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To address the data quality limitations that they argue exist in Hanushek’s work, 
Greenwald, Hedges, and Laine (1996) replicated the 1994 analysis using a more refined 
set of studies. The findings from this study bolster those from their earlier work. 

Although Hanushek and Hedges, Laine, and Greenwald come to different conclusions, 
even Hanushek agrees that the data show that “teachers and schools differ dramatically 
in their effectiveness” (1986, p. 1,159). In more than 30 years of research and study on 
schooling and the educational process since the Coleman Report, a conclusive under- 
standing of the definitive features of quality schools has yet to be found. However, it is 
apparent that no single factor guarantees school quality. As this report makes evident, 
school quality depends on multiple, interdependent elements. Furthermore, as dis- 
cussed throughout this report, research also suggests that one of the main reasons some 
studies have failed to detect why schools differ in their effectiveness is because they use 
poor measures of school quality, and/or they entirely exclude certain elements essential 
to quality. This report identifies where more precise measures are needed and which 
phenomena have not been adequately addressed. 
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The need for more precise measures is evident when considering teacher qualifications. 
Numerous studies examine the relationship between teacher qualifications and student 
learning, but usually they measure whether teachers are certified, whether they have 
master’s degrees, and how long they have taught. When teacher qualifications are meas- 
ured in these ways, the evidence that they make a difference in school quality is incon- 
sistent. This may be because these measures lack specificity. For example, knowing 
whether a teacher is certified or whether a teacher has a master’s degree does not reveal 
anything about whether a teacher is well educated in the subject he or she is teaching. 
Many teachers with master’s degrees are assigned to teach courses for which they have 
had no training. In addition, with the exception of brand new teachers, knowing how 
many years a teacher has taught tells us little about the teacher’s skills. On average, 
researchers have not found a discernible difference between teachers with 5, 10, 15, or 
20 years of experience. As will be discussed in the next chapter, recent research suggests 
that more precise measures of teacher training, experience, and skills are stronger pre- 
dictors of student learning and school quality. 
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Different aspects of the schooling process that may also be related to quality have tradi- 
tionally been understudied in national data-collection efforts. For example, differences 
in student performance may well have to do with content coverage and instructional 
practice (how teachers deliver the content), but until very recently, data on classroom 
practices were in short supply in part because policymakers and researchers emphasized . 
an input-output model when studying schools and because these attributes of the 
schooling process are harder to measure than traditional input indicators. As of the 
mid-1980s, reports began to highlight the importance of delving deeper into what 
schools actually do (see, for example, McKnight et al. 1987; Powell, Farrar, and Cohen 
1985; U.S. Department of Education 1983). The late 1980s marked the first time that 
researchers and policy makers began to push for routine data collection on the school- 
ing process (Murnane and Raizen 1988; Porter 1991; Shavelson et al. 1987; U.S. 
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Department of Education 1988) and national data are just now becoming available (see, 
for example, Hawkins, Stancavage, and Dossey 1998; Henke, Chen, and Goldman 1999). 

g. ODEMTOIPVIM MlCMggS m SCHOOL OgMOW 

This report highlights 13 indicators of school quality that recent research suggests are 
related to student learning and identifies where and why more precise measures are 
needed. These indicators are presented in Figure 1.1 and are categorized as the charac- 
teristics of teachers, the characteristics of classrooms, and the characteristics of schools 
as organizations. The figure illustrates that these school quality factors can affect stu- 
dent learning both directly and indirectly . For example, school context characteristics like 
school leadership can have an impact on teachers and what they are able to accomplish 
in the classroom, and this in turn may influence student learning. In addition, various 
teacher-level attributes can affect the quality of the classroom and in turn student learn- 
ing. Traits at each of these levels can also directly affect student learning. 

The report discusses each of these levels (school, teacher, classroom) in a separate chap- 
ter. The indicators in the chapter on teachers include the academic skills of teachers, 
teaching assignments, teacher experience, and exposure to professional development 
opportunities. Regarding classrooms, the indicators include content coverage, peda- 
gogy, technology, and class size. The chapter on school organization addresses how a 
schools goals, leadership, faculty, discipline policy, and academic environment are indi- 
cators of school quality. 

Each chapter begins with a review of the literature highlighting the particular aspects 
that have been found to be associated with student learning and merit tracking. After 
identifying why a particular aspect qualifies as an indicator, relevant data pertaining to 
the status of that indicator are presented. In cases where inadequate data exist, the 
report discusses why the data are limited and makes recommendations for improving 
these data. 
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In the summer of 1998 when about half the prospective Massachusetts teachers failed 
the states new licensing exam, a discussion about the implications ensued in the nation- 
al media (Sandham 1998; Sterling 1998). What was this test measuring? Why did so 
many teachers fail? Are the prospective teachers who failed unqualified to teach? What 
does this say about the profession as a whole? Who should be allowed to teach in the 
public schools? 

Some researchers suggest that school quality might be inseparable from teacher quality, 
implying that education reformers in Massachusetts and other states may need to use 
tough licensing exams or other teacher- related reforms to make meaningful changes in 
the schools. According to Hanushek (1992), “The estimated difference in annual 
achievement growth between having a good and having a bad teacher can be more than 
one grade-level equivalent in test performance” (p. 107). Rivkin, Hanushek, and Kain 
recently concluded in one study that teacher quality is the most important determinant 
of school quality: 

The issue of whether or not there is significant variation in the quality of 
schools has lingered, quite inappropriately, since the original Coleman Report. 

This analysis identifies large differences in the quality of schools in a way that 
rules out the possibility that they are driven by nonschool factors ... we con- 
clude that the most significant [source of achievement variation] is ... teacher 
quality ... (Rivkin, Hanushek, and Kain 1998, p. 32) 

And yet, even though these researchers found that teacher quality is important, their 
data sets did not contain enough information to allow them to explain what exactly 
makes one teacher more or less effective than another (Rivkin, Hanushek, and Kain 
1998). Other studies, as will be discussed below, suggest that to ensure excellence, teach- 
ers should: 

• Have high academic skills, 

• Be required to teach in the field in which they received their training, 

• Have more than a few years of experience (to be most effective), and 

• Participate in high-quality induction and professional development programs. 

A. MCMgg H: TOE MWg^flC SCCOLtLS (DIP MBS 

Many studies show that students learn more from teachers with strong academic skills 
than they do from teachers with weak academic skills (Ballou 1996; Ehrenberg and 
Brewer 1994; 1995; Ferguson 1991; Ferguson and Ladd 1996; Mosteller and Moynihan 
1972). Because measures of teachers’ academic skills are not routinely collected, the 
number of studies that look at this relationship is limited, and each uses a slightly dif- 
ferent measurement method. The findings, however, are so consistent that there is broad 
agreement that teachers’ academic skills are linked to student learning (Hanushek 1996; 
Hedges, Laine, and Greenwald 1994). This is not to say that academic skills perfectly 
predict how well a person will teach. Some educators argue that teacher quality has less 
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